Papers with explicit causal diagram
Estimating the Causal Effects of Natural Logic Features in Transformer-Based NLI Models (2024.lrec-main)
Copied to clipboard
| Challenge: | a number of studies have reported high accuracies in NLP tasks due to simple heuristics and dataset artifacts. |
| Approach: | They use a case where two words/terms occur in a shared context to construct a causal diagram . they also investigate the robustness to irrelevant changes and sensitivity to impactful changes of Transformers . |
| Outcome: | The proposed method bolsters the fact that similar benchmark accuracy scores may be observed for models that exhibit very different behaviour. |